Comics and cognitive systems: The processing of visual narratives
نویسندگان
چکیده
Humans have drawn sequential images as a means of expression throughout history, from cave paintings and frescoes to wall-carvings and tapestries (McCloud, 1993). In contemporary society, we find them most prevalently in comics of the world, and over the past two decades, increasing attention has turned to this communicative system in the cognitive sciences. Earlier work often focused on theory alone, drawing from paradigms in linguistics or semiotics (for review, see Cohn, 2012; Wildfeuer & Bateman, 2016) or from theorists outside academia (e.g., McCloud, 1993). However, newer studies test theoretical predictions with empirical corpus analyses and both behavioral and neurocognitive experimentation. As in language research, combining these methodologies provides converging evidence on the structure of visual narratives, their diversity across the world, and their comprehension by minds and brains. Recent research has especially focused on the overlapping cognition between the processing of the “visual languages” constituting drawn visual narratives and the linguistic systems of verbal and signed languages (Cohn, 2013; Magliano, Larson, Higgs, & Loschky, 2015). These presentations further such analyses, and explore questions related to the degree to which these visual languages share mechanisms with linguistic and other cognitive systems.
منابع مشابه
Static and dynamic visual narratives, by brain and by eye
Narrative has been studied for millennia, though recent attention in the cognitive sciences has turned towards visual narratives like those found in comics (Cohn, 2013a) and films (Zacks, 2014). Most agree that the basic principles guiding comprehension involve principles that extend across the verbal and visual domains (Cohn, 2013b; Gernsbacher, 1990; Magliano & Zacks, 2011). However, visual u...
متن کاملThe cognition of comics: What "comics" can tell us about the mind
Drawing is a fundamental aspect of human communicative expression, and sequential images have been used to convey information since at least cave paintings. However, only until recently has increased research turned towards studying the cognition of visual narratives—especially those found in comics. The most examined question about visual narratives has asked: How do readers make meaning out o...
متن کاملThe architecture of visual narrative comprehension: the interaction of narrative structure and page layout in understanding comics
How do people make sense of the sequential images in visual narratives like comics? A growing literature of recent research has suggested that this comprehension involves the interaction of multiple systems: The creation of meaning across sequential images relies on a "narrative grammar" that packages conceptual information into categorical roles organized in hierarchic constituents. These imag...
متن کاملWhat is your neural function, visual narrative conjunction? Grammar, meaning, and fluency in sequential image processing
Visual narratives sometimes depict successive images with different characters in the same physical space; corpus analysis has revealed that this occurs more often in Japanese manga than American comics. We used event-related brain potentials to determine whether comprehension of "visual narrative conjunctions" invokes not only incremental mental updating as traditionally assumed, but also, as ...
متن کاملWhen a hit sounds like a kiss: An electrophysiological exploration of semantic processing in visual narrative.
Researchers have long questioned whether information presented through different sensory modalities involves distinct or shared semantic systems. We investigated uni-sensory cross-modal processing by recording event-related brain potentials to words replacing the climactic event in a visual narrative sequence (comics). We compared Onomatopoeic words, which phonetically imitate action sounds (Po...
متن کامل